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nal from the user information input to the user informa- 
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section 11 edits the retrieval result list from the content 
retrieving section 10 based upon its processing ability 
information, and on the other hand, an output content 
editing section 13 edits the contents based upon the ter- 
minal ability information, and then both sections delivers 
through their delivering sections 12, 14 to the terminal, 
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Description 
Technical Field 

[0001] The present invention relates to an apparatus 
and a method for retrieving and delivering contents for 
extracting features and additional information and so on 
from contents, such as analog or digital recorded image 
information and so on to generate registering metadata, 
and then retrieving the contents using such registering 
metadata, transforming the retrieved contents depend- 
ing upon processing ability of a terminal and delivering 
the transformed contents using appropriate telecommu- 
nications means depending upon a type of the network 
to which the terminal is connected. 

Background Art 

[0002] One of conventional systems for retrieving and 
delivering contents on a network is, for example, set 
forth in "A public image database with the aim of trans- 
mitting networked multimedia information: GIRLS" (IP- 
SJ Technical Report, HI67-6, 1996). This system col- 
lects images scattered over the Internet, creates a da- 
tabase automatically, and retrieves desired images from 
the thus created database and delivers the images. 
[0003] In this system, when the database is searched 
on the server side, images similar to user demand are 
retrieved based upon image features registered in the 
database, and at the user side, the images acquired as 
a result of the retrieval are browsed on PCs (Personal 
Computers), workstations and the like. 
[0004] In the conventional system for retrieving and 
delivering contents configured in the above-described 
manner, since it is assumed that terminals that receive 
the contents acquired as a result of the retrieval are PCs, 
workstations and the like all interconnected over the In- 
ternet, which have nearly identical processing ability 
and therefore the contents acquired as a result of the 
retrieval are delivered only in a predefined format, it may 
have such problems that the contents acquired as a re- 
sult of the retrieval may not be browsed easily through 
various different networks, or on various terminals each 
of which has different processing ability such as, for ex- 
ample, cellular phones, videophones, PCs and so on. 
[0005] The present invention has been made to solve 
the above-mentioned problems, and it is an object of the 
present invention to provide an apparatus and a method 
for retrieving and delivering contents that can deliver the 
contents and retrieval result lists acquired as a result of 
retrieval in appropriate various formats according to var- 
ious terminals such as, for example, cellular phones, 
videophones, PCs (Personal Computers) and so on, 
each of which has different processing ability, by way of 
various networks such as telephone lines, wireless net- 
works and so on. 



Summary of the Invention 

[0006] An apparatus for retrieving and delivering a 
content according to the present invention searches a 

s database where contents and their additional informa- 
tion are stored based upon information from a terminal 
and delivers data extracted as a result of the search to 
the terminal, wherein the data extracted as a result of 
the search is edited depending upon processing ability 

10 of the terminal and delivered to the terminal. 

[0007] It has the effect of enabling the data extracted 
from the database to be output easily to the various ter- 
minals each of which has different processing ability. 
[0008] The apparatus for retrieving and delivering the 

15 content according to the present invention comprises: a 
content retrieving section that searches the database 
based upon the information from the terminal, extracts 
the additional information of the content acquired as a 
result of the search and outputs a retrieval result list in 

20 which the additional information is published; a retrieval 
result list editing section that, based upon the informa- 
tion from the terminal, edits the retrieval result list ob- 
tained from the content retrieving section into any format 
that can be displayed on a particular terminal depending 

25 upon processing ability of the terminal; and a retrieval 
result list delivering section that delivers the retrieval re- 
sult list edited by the retrieval result list editing section 
to the terminal. 

[0009] It has the effect of enabling the content extract- 
30 ed from the database and the retrieval result list to be 
output easily to the various terminals each of which has 
different processing ability. 

[001 0] The apparatus for retrieving and delivering the 
contents according to the present invention is provided 

35 wherein the database stores weighted registering meta- 
data as the additional information, and the content re- 
trieving section searches the database with reference 
to the registering metadata based upon the information 
obtained from the terminal and extracts the additional 

40 information of the content acquired as a result of the 
search. 

[0011] It has the effect of enabling the content extract- 
ed from the database and the retrieval result list to be 
output easily to the various terminals each of which has 
45 different processing ability as well as to be retrieved 
quickly. 

[001 2] The apparatus for retrieving and delivering the 
content according to the present invention further com- 
prises a retrieving metadata generating section that 

50 generates metadata for retrieving a content based upon 
the information from the terminal and outputs it to the 
content retrieving section, and in that the content retriev- 
ing section searches the database based upon the in- 
formation from the terminal and the metadata from the 

55 retrieving metadata generating section, extracts the ad- 
ditional information of the content acquired as a result 
of the search, and outputs the retrieval result list in which 
the additional information is published. 
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[0013] It has the effect of making circuit size of the 
terminal smaller, since the terminal may not comprise 
the retrieving metadata generating section. 
[001 4] The apparatus for retrieving and delivering a 
content according to the present invention comprises: 
an output content editing section that reads a content 
from the database based upon the information obtained 
from the terminal and edits the read content into any for- 
mat that can be processed on the particular terminal de- 
pending upon processing ability of the terminal; and a 
content delivering section that delivers the content ed- 
ited by the output content editing section to the terminal. 
[0015] 1 1 has the effect of the contents extracted from 
the database and the retrieval result list to be output eas- 
ily to the various terminals each of which has different 
processing ability. 

[001 6] The apparatus for retrieving and delivering a 
content according to the present invention is provided 
wherein the database either stores contents and regis- 
tering metadata for the particular contents, or stores link 
information to contents and registering metadata for the 
particular contents, and the output content editing sec- 
tion further reads the link information from the database 
based upon the information from the terminal and then 
reads a content based upon the link information. 
[0017] It has the effect of enabling the database to 
register more contents because it stores the link infor- 
mation to the contents instead of the particular contents. 
[001 8] A method for retrieving and delivering a con- 
tent according to the present invention searches a da- 
tabase where contents and their additional information 
are stored based upon information from a terminal and 
delivers data extracted as a result of the search to the 
terminal, wherein the data extracted as a result of the 
search is edited depending upon processing ability of 
the terminal and delivered to the terminal. 
[001 9] It has the effect of enabling the data extracted 
from the database to be output easily to the various ter- 
minals each of which has different processing ability. 

Brief Description of the Drawings 

[0020] 

Fig. 1 is a diagram showing the overall configuration 
of a system for retrieving and delivering contents of 
the present invention; 

Fig. 2 is a diagram showing the configuration of an 
apparatus A for retrieving and delivering contents 
according to a first embodiment; 
Fig. 3 is a flow chart showing the process of an input 
data registering section 1 in the apparatus A for re- 
trieving and delivering the contents according to the 
first embodiment for registering new contents in a 
database B. 

Fig. 4 is a flow chart showing the process of a re- 
trieving and delivering service section 5 in the ap- 
paratus A for retrieving and delivering the contents 



according to the first embodiment; 
Fig. 5 is a diagram showing the configuration of a 
terminal D in the system for retrieving and delivering 
images according to the first embodiment; 

s Fig. 6 is a flow chart showing the process of the ter- 

minal D in the system for retrieving and delivering 
the contents according to the first embodiment; 
Fig. 7(a) and Fig. 7(b) are diagrams each showing 
an example of retrieval results shown on a retrieval 

10 result list displaying section 31 of the terminal D; 

Fig. 8 is a diagram showing the configuration of the 
terminal D that corresponds to the apparatus A for 
retrieving and delivering the contents according to 
a second embodiment; 

15 Fig. 9 is a diagram showing the configuration of the 
apparatus A for retrieving and delivering the con- 
tents according to the second embodiment; 
Fig. 10 is a diagram showing the configuration of 
the apparatus A for retrieving and delivering the 

20 contents according to a third embodiment; 

Fig. 11 is a flowchart showing the process of the 
input data registering section 1 in the apparatus A 
for retrieving and delivering the contents of the third 
embodiment for registering new contents in the da- 

25 tabase B; 

Fig. 12 is a flowchart showing the process of the 
retrieving and delivering service section 5 in the ap- 
paratus A for retrieving and delivering the contents 
of the third embodiment; and 

30 Fig. 1 3 is a diagram showing an example of a weight 
coefficient table in the fourth embodiment. 

Best Mode of Carrying Out the Invention 

35 [002 1 ] Hereinafter, in order to describe the present in- 
vention in more detail, the best mode of carrying out the 
present invention will be described with reference to the 
accompanying drawings. 

40 (First Embodiment) 

[0022] Fig. 1 is a diagram showing an overall config- 
uration of a system for retrieving and delivering a con- 
tent. In Fig. 1, A designates an apparatus for retrieving 

45 and delivering a content according to the present inven- 
tion that includes a server and so on, B designates a 
database in which various contents and a registering 
metadata for the contents are stored, C designates var- 
ious networks such as Internet, ISDN telephone lines, 

so wireless links, dedicated cable links, terrestrial/satellite 
TV networks and the like, and D designates various ter- 
minals such as PCs, cellular phones, personal digital as- 
sistants, digital TV sets and the like that act as clients 
from a point of view of the apparatus A for retrieving and 

55 delivering the content, and each of which has different 
processing ability. 

[0023] In such a system for retrieving and delivering 
the content, for example, terminals D such as PCs and 
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so on can connect to networks C such as the Internet 
and so on through LANs and so on, other terminals D 
can connect to the networks C such as the Internet and 
soon through existing telephone lines such as ISDN and 
so on, terminals D that have wireless links, such as cel- 
lular phones, personal digital assistants and so on can 
connect to networks C in a wireless manner, and termi- 
nals D such as digital TV and so on can connect to net- 
works C such as terrestrial/satellite TV networks and so 
on. 

[0024] Fig. 2 is a diagram showing the configuration 
of the apparatus A for retrieving and delivering the con- 
tent according to the first embodiment. In Fig. 2, an input 
data registering section 1 inputs a content, adds a meta- 
data thereto and inputs to the database, a data inputting 
section 2 inputs a content to be registered in the data- 
base B, a registering metadata generating section 3 ex- 
tracts features and additional information and so on from 
the content that has been input to the data inputting sec- 
tion 2 and adds the thus extracted information to the 
content as a registering metadata. At this time, it is to 
be noted that the registering metadata that has been 
generated in the registering metadata generating sec- 
tion 3 and the content are stored in the database B. 
[0025] Here, the registering metadata generating sec- 
tion 3 extracts the "features of a content" including at 
least any one of, for example, color information of imag- 
es, texture information of images, motion information, 
object shape information, frequency response informa- 
tion of sounds, loudness information of sounds, sound 
source information and language recognition informa- 
tion of sounds. Further, the registering metadata gener- 
ating section 3 extracts "the additional information about 
a content" including at least any one of information 
about image formatting such as a coding method of im- 
ages, a bit rate of images, a frame rate of images • res- 
olution of images, information about time-space layering 
of images and so on, a coding method of sounds, a bit 
rate of sounds, description information about compo- 
nents that make up a content (images, sounds, texts and 
so on), information about copyright on a content, infor- 
mation about distributing conditions (charged/free of 
charge and so on), a file size of a content, a filename of 
a content, an identification number of a content, text in- 
formation about an author of a content, information 
about the time of creation of a content, thumbnails of an 
image, a portion of an image and a portion of sounds. 
[0026] Further, in Fig. 2, a retrieving and delivering 
service section 5 retrieves a content that meets user de- 
mand from the database B, transforms a list of the con- 
tent thus acquired as a result of the retrieval depending 
upon processing ability of the terminal D and outputs the 
list to the terminal D, and then transforms the content 
specified by the user into any format that can be proc- 
essed on the terminal D and delivers the content, a user 
demand inputting section 6 inputs user demands such 
as a signal from the terminal D that demands retrieval, 
identification information about the content that the user 



demands to be output and so on, a retrieval key inputting 
section 7 inputs retrieval keys specified by the user from 
the terminal D, a user information inputting section 8 in- 
puts user identification information and user information 

5 about the terminal D from the terminal D, a terminal abil- 
ity information acquiring section 9 acquires information 
about processing ability of the terminal D as "terminal 
ability information" included in the user identification in- 
formation and the user information about the terminal D 

10 input to the user information inputting section 8, and a 
content retrieving section 10 retrieves the content that 
is consistent with or similar to the retrieval key input by 
the retrieval key inputting section 7 from the database 
B and outputs "a retrieval result list" that is a list of in- 

*5 formation such as registering metadata about one or 
more contents selected as a result of the retrieval and 
so on. 

[0027] Still further, in Fig. 2, a retrieval result list edit- 
ing section 1 1 which edits, based upon the terminal abil- 

20 ity information acquired in the terminal ability informa- 
tion acquiring section 9, the retrieval result list output 
from the content retrieving section 10 into any format 
that can be displayed on the terminal D and outputs it, 
a retrieval result list delivering section 12 outputs the 

25 retrieval result list that has been edited and output from 
the retrieval result list editing section 11 to the user, an 
output content editing section 1 3 inputs a content from 
the database B that has been specified by the user via 
the user demand inputting section 6, inputs the terminal 

30 ability information acquired in the terminal ability infor- 
mation acquiring section 9, and edits the content read 
from the database B by transforming or otherwise 
processing the content into any format that can be proc- 
essed on the terminal D and outputs the content, and a 

35 content delivering section 1 4 delivers the edited content 
output from the output content editing section 1 3 to the 
terminal D. 

[0028] In the embodiment shown in Fig. 2, though the 
apparatus A for retrieving and delivering the content is 

40 comprised of the input data registering section 1 and the 
retrieving and delivering service section 5, the present 
invention should not be limited to such configuration, 
that is, the apparatus A for retrieving and delivering the 
content may be comprised of the input data registering 

45 section 1, the retrieving and delivering service section 
5 and the database B, or it may be comprised of the 
retrieving and delivering service section 5 only. 
[0029] Next, an operation of the apparatus A for re- 
trieving and delivering the content will be described. 

so [0030] To begin with, a process of the input data reg- 
istering section 1 will be described in detail. 
[0031] Fig. 3 is a flow chart showing the process of 
the input data registering section 1 in the apparatus A 
for retrieving and delivering the content according to the 

55 first embodiment for registering a new content in the da- 
tabase B. 

[0032] First, the data inputting section 2, which com- 
prises either one or both of an interface for inputting a 
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content via the network C and another interface for in- 
putting a content directly without the network C, inputs 
the content from outside in either way and outputs the 
content to the registering metadata generating section 
3(StepST1). 5 
[0033] Here, a new content may be input in various 
ways, such as by transmitting from the terminal D to the 
input data registering section 1 via the network C, or by 
inputting directly in the apparatus A for retrieving and 
delivering the content that comprises the input data reg- 
istering section 1 and so on. For example, the content 
such as images and sounds recorded by a cellular 
phone equipped with a camera, or the content such as 
images and sounds received by e-mail and the like may 
be registered on the apparatus A by transmitting from 
the terminal D. On the other hand, a content may be 
input directly via the data inputting section 2 to the ap- 
paratus A for retrieving and delivering the content when 
an output connector of a camera, a video camera, a PC 
and so on is connected directly to an input connector 
(not shown) of the apparatus A for retrieving and deliv- 
ering the content. For such purpose, as discussed 
above, the data inputting section 2 comprises either one 
or both of the interface for inputting the content via the 
network C and the other interface for inputting the con- 
tent directly without the network C. 
[0034] The registering metadata generating section 3 
extracts information such as features, additional infor- 
mation and the like from the read content (Step ST2). 
Here, the extracted features may include, for example, 
color, texture, motion and shape of images in the read 
content, frequency characteristics of sounds in the read 
content and so on. Further, keywords describing fea- 
tures of the read content and additional information 
about the read content may be added. 
[0035] Here, the additional information may include, 
for example, information about image formatting such 
as a coding method (MPEG-1, MPEG-2, MPEG-4, 
JPEG, GIF, BMP and so on) of images included in the 
content, a bit rate, a frame rate, resolution, information 
about time-space layering and so on, a coding method 
(GSM- AMR, MPEG-1, MPEG-2, MPEG-4 and so on) 
and a bit rate of sounds included in the content, descrip- 
tions of components that make up the content (images, 
sounds, texts, software), information about copyright on 
the content, information about distributing conditions of 
the read content (charged/free of charge and so on), a 
file size of the content, a filename, an identification 
number, information about the author, information about 
the time of creation of the content, thumbnails of the im- 
ages included in the content, a portion of images, a por- 
tion of sounds and the like. 

[0036] Then, the registering metadata generating 
section 3, using the features of the content and the ad- 
ditional information and so on extracted in an above-de- 
scribed manner, generates registering metadata (a fea- 
ture descriptor) that is described in a predefined format, 
such as, for example, a format defined by MPEG-7 and 



the like (Step ST3), adds the thus generated registering 
metadata to the corresponding content, and stores the 
content and the registering metadata in the database B 
(Step ST4). 

[0037] Next, the process of the retrieving and deliver- 
ing service section 5 will be described in detail. 
[0038] Fig. 4 is a flowchart showing the process of a 
retrieving and delivering service section 5 in the appa- 
ratus A for retrieving and delivering the content accord- 
ing to the first embodiment. 

[0039] First, information about the user is input from 
the terminal D to the user information inputting section 
8 (Step ST11). The information about the user may in- 
clude, for example, user identification information such 
as a user name, a user registration number, the name 
of a group which the user belongs to and so on, the type 
of the terminal D, information about the processing abil- 
ity of the terminal D and so on. 

[0040] Next, retrieval keys are input from the terminal 
D to the retrieval key inputting section 7 (Step ST12), 
and then a signal that demands retrieval is input from 
the terminal D to the user demand inputting section 6 
(Step ST13). Here, the retrieval keys may include, for 
example, a keyword, the registering metadata describ- 
ing the features of the content and the additional infor- 
mation, a file format of images, sounds and other data 
included in the content, resolution, a file size and so on. 
[0041] When the retrieval demanding signal and the 
retrieval keys are input, the content retrieving section 1 0 
matches the retrieval key with the keyword and the fea- 
tures described in the registering metadata contained in 
the database B (Step ST14), retrieves one or more con- 
tents that are consistent with or similar to the retrieval 
key, extracts the additional information such as the reg- 
istering metadata and the like, which are stored along 
with the one or more contents thus acquired as a result 
of the retrieval, and outputs it as the retrieval result list 
to the retrieval result list editing section (Step ST15). 
[0042] Here, information published in the retrieval re- 
sult list may include, for example, information about im- 
age formatting such as a coding method of images in- 
cluded in the content (MPEG-1, MPEG-2, MPEG-4, 
jpEG, GIF, BMP and so on), a bit rate, a frame rate, 
resolution, information about time-space layering and 
soon, a coding method (GSM-AMR, MPEG-1, MPEG- 
2, MPEG-4 and so on) and a bit rate of sounds included 
in the contents, descriptions of components that make 
up a content (images, sounds, texts, software), informa- 
tion about copyright on the a content, information about 
distributing conditions of the read content (charged/free 
of charge and so on), a file size of the content, a filena- 
me, an identification number, information about the au- 
thor, information about the time of creation of the con- 
tent, thumbnails of the images included in the content, 
a portion of images, a portion of sounds and the like. 
[0043] Next, the terminal ability information acquiring 
section 9 acquires terminal ability information about 
processing ability of the terminal D that is included in 
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the user information input to the user information input- 
ting section 8 from the terminal D, and outputs it to the 
retrieval result list editing section 11 (Step ST16). At this 
time, though it is assumed that the terminal ability infor- 
mation is acquired from the terminal D in the first em- 
bodiment, the present invention should not be limited to 
such configuration, that is, for example, if the apparatus 
A for retrieving and delivering the content has a user 
registration function, information about the receiving ter- 
minal of the user may be registered in the apparatus A 
upon user registration in advance, and the terminal abil- 
ity information registered in the apparatus A for retriev- 
ing and delivering the content may be acquired by re- 
ferring to the user identification information. Here, the 
terminal ability information may include a coding method 
of images used in the terminal D, resolution of images 
that can be received and displayed on the terminal D, a 
bit rate, a frame rate, a coding method of sounds used 
in the terminal D, a bit rate of sounds that can be re- 
ceived and displayed or otherwise can be output on the 
terminal D and the like. 

[0044] Then, since the retrieval result list editing sec- 
tion 11 also inputs the retrieval result list that has been 
output from the content retrieval section 10, the retrieval 
result list editing section 11, based upon the terminal 
ability information from the terminal ability information 
acquiring section 9, edits the retrieval result list, that is, 
extracts only the information that can be received and 
displayed or otherwise output on the terminal D out of 
the information included in the retrieval result list from 
the content retrieval list 10 and so on, and outputs the 
edited retrieval result list to the retrieval result list deliv- 
ering section 12 (Step ST 17), and then, the retrieval re- 
sult list delivering section 12 delivers the retrieval result 
list that has been edited by the retrieval result list editing 
section 11 to the terminal D that has demanded retrieval 
of the content (Step ST18). 

[0045] The information that has been published in the 
retrieval result list and delivered to the terminal D may 
include, for example, a file name of the content that has 
been extracted as a result of the retrieval, the name of 
a coding method of images in the extracted content, and 
JPEG or other coded thumbnail images, and so on. 
However, if the terminal D such as, for example, a cel- 
lular phone terminal, does not have the function to de- 
code and display JPEG or other coded images at 
present, the JPEG or other coded thumbnail images 
may be excluded from the retrieval result list, and the 
retrieval result list may be edited so that it includes only 
information that can be displayed on the terminal D like 
the cellular phone terminal and so on, such as a file 
name of a content, the name of a coding method of im- 
ages of a content and so on, and such retrieval result 
list may be delivered to the terminal D. 
[0046] When the retrieval result list is displayed on the 
terminal D, the user sends user's demand that specifies 
particular content out of the contents listed in the retriev- 
al result list using the content identification information 



10 

to the apparatus A for retrieving and delivering the con- 
tent via the network C. 

[0047] Then, in the apparatus A for retrieving and de- 
livering the content, the user demand inputting section 

5 6 in the retrieving and delivering service section 5 inputs 
the user demand from the terminal D and outputs it to 
the output content editing section 13 (Step ST19). 
[0048] The output content editing section 1 3 reads the 
content specified by the content identification informa- 

10 tion that has been input from the user demand inputting 
section 6 as well as the registering metadata for the 
specified content (Step ST20), determines whether or 
not the thus read content can be received and displayed 
or can be otherwise output on the terminal D that has 

15 sent the user demand, on the basis of the terminal ability 
information about the terminal D concerned (Step 
ST21). 

[0049] Here, if the output content editing section 13 
determines that the content read from the database B 

20 can be received and displayed or otherwise can be out- 
put on the terminal D without further editing (Step ST21 
"Yes"), it outputs the relevant content read from the da- 
tabase B to the content delivering section 14. Then, the 
content delivering section 14 delivers the content output 

25 from the output content editing section 1 3 to the terminal 
D(StepST23). 

[0050] In contrast to this, if the output content editing 
section 13 determines that the content read from the da- 
tabase B can not be received and displayed or otherwise 

30 output on the terminal D (Step ST21 "No"), it edits the 
content read from the database B by transforming or 
otherwise processing the content into a form that can 
be received and displayed or can be otherwise output 
on the terminal D (Step ST22), and then outputs the ed- 

35 jted content to the content delivering section 1 4. At this 
time, the transforming process performed in the output 
content editing section 13 may include conversion of a 
coding method, resolution, a bit rate, frame rate of im- 
ages, conversion of a coding method, bit rate of sounds 
and the like. Alternatively, a process to extract a portion 
of the content may be performed as needed: for exam- 
ple, If the content is composed of images and sounds 
and the terminal D does not support sound data, only 
the images included in the content may be extracted. 

45 Or, if, for example, the content is layered data that is 
composed of a base layer and an enhancement layer 
and the terminal 0 supports the base layer only and 
does not support the enhancement layer, only the base 
layer may be extracted. 

so [0051] The content delivering section 14 delivers the 
content that has been transformed into a form that can 
be received and displayed or otherwise output on the 
terminal D as described above to the terminal D (Step 
ST23). 

55 [0052] Fig. 5 is a diagram showing the configuration 
of a terminal D in the system for retrieving and delivering 
images in the first embodiment. 
[0053] In Fig. 5, a retrieval demanding section 21 in- 
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puts retrieval keys and user commands from the user, 
extracts features and additional Information out of the 
thus read content and adds them to the retrieval key as 
a registering metadata, and sends the terminal ability 
information, the retrieval keys and the user commands 
to the apparatus A for retrieving and delivering the con- 
tent, a user command inputting section 22 inputs user 
demands, such as a user command to demand retrieval, 
identification information of the content, the output of 
which the user demands, and so on, a user information 
outputting section 23 outputs user identification informa- 
tion and user information about the terminal D, a content 
inputting section 24 captures a content to be retrieved, 
which is comprised of images, sounds and so on from 
a digital video camera and the like, and a user retrieval 
key inputting section 25 inputs user retrieval keys spec- 
ified by the user. 

[0054] Further, in Fig. 5, a retrieving metadata gener- 
ating section 26 extracts features, additional information 
and so on of the content to be retrieved, which have 
been input from the content inputting section 24 and out- 
puts them as a registering metadata, a retrieval key out- 
putting section 27 outputs, as retrieval keys, the user 
retrieval keys that have been input in the user retrieval 
key inputting section 25 and the registering metadata 
that has been generated in the retrieving metadata gen- 
erating section 26 to the apparatus A for retrieving and 
delivering the content, and a user demand outputting 
section 28 outputs user demands such as a signal by 
which the user demands retrieval, identification informa- 
tion of the content, the output of which the user de- 
mands, and the like to the apparatus A for retrieving and 
delivering the content. 

[0055] Still further, in Fig. 5, a retrieval results 
processing section 29 receives information acquired as 
a result of the retrieval performed by the apparatus A for 
retrieving and delivering the content and outputs the in- 
formation to the user, a retrieval result list inputting sec- 
tion 30 receives a retrieval result list acquired as a result 
of the retrieval by the apparatus A for retrieving and de- 
livering the content from the apparatus A, a retrieval re- 
sult list displaying section 31 displays the retrieval result 
list input from the retrieval result list inputting section 30, 
a content receiving section 32 receives a content that is 
listed in the retrieval result list and specified by the user 
from the apparatus A for retrieving and delivering the 
content, and a content outputting section 33 displays the 
content received in the content receiving section 32 to 
the user or outputs in the form of sounds and the like. 
At this time, in the above description of the first embod- 
iment, though the terminal D is equipped with both the 
retrieval demanding section 21 and the retrieval results 
processing section 29, the present invention should not 
be limited to such configuration, and the retrieval de- 
manding section 21 and the retrieval results processing 
section 29 may be, of course, included in different ter- 
minals D separately. 

[0056] Next, the process of the terminal D of the first 



embodiment of the present invention will be described 
in detail. 

[0057] Fig. 6 is a flowchart showing the process of a 
terminal D in the system for retrieving and delivering the 

s content according to the first embodiment. 

[0058] When the terminal D is connected to the appa- 
ratus A for retrieving and delivering the content acting 
as a server via the network C through manipulation of 
the terminal D or other operation by the user, user infor- 

10 mation is at first sent from the user information output- 
ting section 23 of the terminal D to the apparatus A for 
retrieving and delivering the content (Step ST31). The 
user information may include user identification informa- 
tion, the type of the terminal D, information about 

15 processing ability of the terminal D and the like. Here, 
the user information is input by the user command in- 
putting section 22, wherein it can be arranged such that 
the user information is input by the user command in- 
putting section 22 after the terminal D has been con- 

20 nected to the apparatus A for retrieving and delivering 
the content and at the same time it may be sent to the 
apparatus A for retrieving and delivering the content, or 
alternatively, of course, the apparatus A may be config- 
ured so that the user information may be input by the 

25 user command inputting section 22 in advance and 
stored in the user information outputting section 23 and 
then, upon connection to the apparatus A for retrieving 
and delivering the content, it may be sent to the appa- 
ratus A for retrieving and delivering the content by the 

30 user information outputting section 23. 

[0059] Next, the user inputs the content to be re- 
trieved to the content inputting section 24 of the terminal 
D (Step ST32). Here, the input content such as images, 
sounds and the like may be captured directly from a dig- 

35 ital video camera, a microphone and the like, or through 
the network C or in other manner. 
[0060] The content that has been input to the content 
inputting section 24 are output to the retrieving metadata 
generating section 26, and the retrieving metadata gen- 

40 erating section 26 extracts features, additional informa- 
tion and so on of the content to be retrieved and outputs 
them as the registering metadata to the retrieval key out- 
putting section 27 (Step ST33). The features extracted 
in the retrieving metadata generating section 26 may in- 

45 elude, for example, color, texture, motion and shape of 
images in the content to be retrieved, frequency re- 
sponse of sounds in the read content and so on. On the 
other hand, the additional information extracted in the 
retrieving metadata generating section 26 may include, 

so for example, a coding method (MPEG-1, MPEG-2, 
MPEG-4, JPEG, GIF, BMP and so on), a bit rate, a frame 
rate, resolution of the images included in the content to 
be retrieved, and a coding method (GSM-AMR, MPEG- 
1, MPEG-2, MPEG-4 and so on), a bit rate and the like 

55 of the sounds included in the content. 

[0061] Next, user retrieval keys specified by the user 
are input to the user retrieval key inputting section 25 
and then output to the retrieval key outputting section 
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27 (Step ST34). The user retrieval keys may comprise, 
for example, a keyword for the content, a filename, a file 
size, information about the time of creation of the con- 
tent, rough information about the color, texture, motion 
and shape of the content, rough frequency response of 
the sounds and the like. 

[0062] Then, when the registering metadata generat- 
ed in the retrieving metadata generating section 26 and 
the user retrieval keys input from the user retrieval key 
inputting section 25 are output to the retrieval keys out- 
putting section 27 as "retrieval keys", the retrieval key 
outputting section 27 outputs the retrieval keys consist- 
ing of the registering metadata and the user retrieval 
keys via the network C to the apparatus A for retrieving 
and delivering the content acting as the server (Step 
ST35). 

[0063] On the other hand, when the user inputs a 
command for demanding retrieval to the apparatus A for 
retrieving and delivering the content via the user com- 
mand inputting section 22, the retrieval demanding sig- 
nal is sent to the apparatus A for retrieving and deliver- 
ing the content via the user demand outputting section 

28 (Step ST36). Here, operation to output each of the 
information from the terminal D in these Steps ST31, 35 
and 36 may be performed in any order that is not limited 
to the above description. 

[0064] Then, when the apparatus A for retrieving and 
delivering the content receives the retrieval demanding 
signal, the registering metadata and the user retrieval 
keys that have been sent via the network C from the 
terminal D through manipulation by the user, it retrieves 
the content on the database B based upon the retrieval 
keys sent by the user as described above. The retrieval 
result list that has been generated as a result of the re- 
trieval by the apparatus A for retrieving and delivering 
the content is sent via the network C to the terminal D 
as described above, and in the terminal D, the retrieval 
result list inputting section 30 in the retrieval results 
processing section 29 receives the retrieval result list 
that has been sent from the apparatus A for retrieving 
and delivering the content (Step ST37). 
[0065] The retrieval result list inputting section 30 dis- 
plays the received retrieval result list on the retrieval re- 
sult list displaying section 31 to allow the user of the ter- 
minal D to browse the retrieval result list (Step ST38). 
[0066] The user, referring to the retrieval result list dis- 
played on the retrieval result list displaying section 31 , 
selects the content which the user desires to be deliv- 
ered in the retrieval result list and inputs the identifica- 
tion information of the selected content to the user com- 
mand inputting section 22 of the terminal D (Step ST39). 
[0067] Then, the identification information of the con- 
tent that has been input to the user command inputting 
section 22 is output from the user demand outputting 
section 28 and sent via the network C to the apparatus 
A for retrieving and delivering the content acting as the 
server (Step ST40). 

[0068] As described above, the apparatus A for re- 



trieving and delivering the content reads the content 
specified by the user according to the content identifi- 
cation information received from the user and delivers 
the content to the terminal D of the pertinent user. 

5 [0069] As a consequence, the content that has been 
delivered from the apparatus A for retrieving and deliv- 
ering the content is received in the content receiving 
section 32 of the terminal D of the pertinent user (Step 
ST41), and is output to the user by the content outputting 

10 section 33 in any outputting format depending upon 
each media such as images, sounds and so on (Step 
ST42). At this time, the contents may be displayed on 
the retrieval result list displaying section 31 along with 
or aside from the retrieval result. 

15 [0070] Next, by way of example, an operation of the 
system for retrieving and delivering the content accord- 
ing to the first embodiment will be described in a case 
where the apparatus A for retrieving and delivering the 
content in which a video content on sports are stored is 

20 accessed and searched to seek tee shot scenes of var- 
ious golfers and information about the golfers (names 
of the golfers, front facial portrait images, birthplaces, 
average scores, international rankings, awards that the 
golfers have received and the like) that will be extracted 

25 as a result of retrieval with reference to a tee shot scene 
at golf shot by a digital video camera and the like. 
[0071 ] In this example, let us assume that scenes sim- 
ilar to the tee shot scene at golf taken by the terminal D 
will be retrieved. 

30 [0072] First, as discussed above, when the terminal 
D is connected to the apparatus A for retrieving and de- 
livering the content via the network C, various user in- 
formation including the user identification such as, for 
example, a log-in name to access to the apparatus A for 

35 retrieving and delivering the content and so on, and in- 
formation about processing ability of the terminal D, 
such as, for example, about the fact that it can receive 
and display images of MPEG-4 coding format and of 1 76 
x 144 pixels in size and it can receive and output sounds 

<o of GSM-AMR or other coding formats and so on are sent 
from the user information outputting section 23 of the 
terminal D to the apparatus A for retrieving and deliver- 
ing the content via the network C. 
[0073] Then, the user information about the terminal 

45 d is input to the user information inputting section 8 of 
the apparatus A for retrieving and delivering the content, 
and the terminal ability information acquiring section 9 
acquires the terminal ability information about the termi- 
nal D from the user information of the terminal D input 

so to the user information inputting section 8. 

[0074] On the other hand, an image shot or otherwise 
acquired by the terminal D using a camera or other 
means (not shown) installed in itself or in other appara- 
tus is input to the content inputting section 24 of the ter- 

55 minal D that may be a cellular phone and the like. The 
image input to the content inputting section 24 is sent to 
the retrieving metadata generating section 26 that ex- 
tracts features included in the entire image or objects 
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within the image, such as shape, color, motion, texture 
and the like and sends the features to the retrieval key 
outputting section 27 as a registering metadata. 
[0075] Further, certain conditions such as, for exam- 
ple, that "the content extracted as a result of the retrieval 
should not be constrained by any distributing condition'' 
or "the content extracted as a result of the retrieval 
should include a video content of the golfers in place not 
lower than tenth in international ranking only" and so on 
are input to the user retrieval key inputting section 25 
as the user input retrieval keys, and the user input re- 
trieval keys are sent to the retrieval key outputting sec- 
tion 27. 

[0076] Still further, when the user inputs a retrieval de- 
manding command to the user command inputting sec- 
tion 22, a retrieval demanding signal is sent from the 
user demand outputting section 28 to the user demand 
inputting section 6 of the apparatus A for retrieving and 
delivering the content, and then, the registering meta- 
data and the user retrieval keys output from the retrieval 
key outputting section 27 are sent to the retrieval key 
% inputting section 7 of the apparatus A for retrieving and 
delivering the content as the retrieval keys. 
[0077] The content retrieving section 1 0 of the appa- 
ratus A for retrieving and delivering the content, based 
upon the registering metadata and the user retrieval 
keys input to the data inputting section 2 from the termi- 
nal D, performs matching of the features described in 
the registering metadata stored in the database B with 
the features described in the retrieval keys, and conse- 
quently, extracts information only from the video content 
that have features consistent with or similar to the reg- 
istering metadata and the user retrieval keys from the 
terminal D and satisfy the conditions specified in the re- 
trieval keys. 

[0078] The information about the video content ex- 
tracted here may include, for example, the first one 
frame image of the video content, a registration number 
of the video content, a filename, a file size, a coding 
method of images and sounds, resolution, a bit rate and 
a frame rate of images, a bit rate of sounds, text data 
describing the video content and so on. Such informa- 
tion about the video content is sent to the retrieval result 
list editing section 11 as the retrieval result list. 
[0079] As described above, the retrieval result list ed- 
iting section 11 edits the retrieval result list by transform- 
ing or otherwise processing the list depending upon the 
ability of the terminal D. 

[0080] The retrieval result list edited by the retrieval 
result list editing section 11 is sent from the retrieval list 
delivering section 12 to the terminal D via the network 
C and input to the retrieval result list inputting section 
30 of the terminal D. The retrieval result list that has 
been input to the retrieval result list inputting section 30 
is displayed by the retrieval result list displaying section 
31. 

[0081] In Fig. 7(a) and Fig. 7(b), there is shown an 
example of the retrieval results displayed by the retrieval 



11 777 A1 16 

result list displaying section 31 of the terminal D. 
[0082] Fig. 7(a) shows an example of the retrieval re- 
sult list displayed on the retrieval result list displaying 
section 31 of the terminal D such as a PC and the like, 

5 which has sufficient ability to display and process the 
list. In Fig. 7(a), reference numeral 31a denotes an im- 
age to be retrieved that has been input by the user via 
the content inputting section 24 and the like, and that 
may be, for example, a putting scene at golf and the like. 

10 Reference numeral 31b denotes a screen for the retriev- 
al results acquired as a result of the retrieval by the con- 
tent retrieving section 10 and sent from the retrieval re- 
sult list editing section 11 of the apparatus A for retriev- 
ing and delivering the content, wherein 31 c1 - 31c3 are 

*5 pictures of the retrieval results 1, 2, 3, ... that are dis- 
played on the screen 31 b for the retrieval result and that 
may be thumbnails or other images of a plurality of 
putting scenes at golf that have been acquired as a re- 
sult of the retrieval and displayed on the retrieval results 

20 screen 31a and are consistent with or similar to the im- 
ages 31a to be retrieved, and 31 d1 - 31d3 are data com- 
prised of text or other information about the retrieval re- 
sults 1,2, 3, ... corresponding to the pictures 31 c1 -31 c3 
of the retrieval results 1, 2, 3, respectively, that may 

25 be data on the golfers who are putting in the pictures 
such as, for example, names of the golfers, front facial 
portrait images, birthplaces, average scores, interna- 
tional rankings, awards that the golfers have received 
and so on. 

30 [0083] Fig. 7(b) shows an example of retrieval result 
list displayed on the retrieval result list displaying sec- 
tion 31 when the retrieval result list has been sent to the 
terminal D that has a smaller display screen, or to which 
larger information cannot be downloaded due to its 

35 heavy load. In this case, as shown in Fig. 7(b), for ex- 
ample, there is shown data 31 e comprised of text or oth- 
er information about the retrieval result 1 (the golfer 1) 
within the retrieval result list in conjunction with selecting 
buttons including a "previous candidate" button to call 

40 up data on the previous candidate, e.g. the retrieval re- 
sult 0 (the golfer 0), a "next candidate" button to call up 
data on the next candidate, e.g. the retrieval result 2 (the 
golfer 2), an "image display" button to allow the image 
of the presently displayed retrieval result 1 (the golfer 1) 

45 to be appeared, and the like. 

[0084] With reference to the retrieval result list dis- 
played on the retrieval result list displaying section 31 
as described above, the user selects the content that 
the user desires to be delivered within the displayed re- 

50 trieval result list and inputs identification information 
about the selected content to the user command input- 
ting section 22. Here, any means or method that can 
identify the particular content within the retrieval result 
list may be used as the content identification informa- 

55 tion, and therefore, for example, when index or other 
numbers are added to each of the content information 
listed in the retrieval result list, the index or other num- 
bers may be used as the identification information. 
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[0085] Then, the content identification information 
that has been input to the user command inputting sec- 
tion 22 is output from the user demand outputting sec- 
tion 28, sent to the apparatus A for retrieving and deliv- 
ering the content A via the network C, and input to the 
user demand inputting section 6 of the apparatus A for 
retrieving and delivering the content. 
[0086] The content identification information that has 
been input to the user demand inputting section 6 is out- 
put to the output content editing section 1 3, and the out- 
put content editing section 1 3 reads the content that the 
user desires to be delivered from the database B based 
upon the input content identification information. 
[0087] Then, the output content editing section 13 
transforms the content read from the database B into 
any format that is suitable for the ability of the terminal 
D to which the content is to be delivered by transforming 
the format of the content or otherwise processing the 
content, based upon the terminal ability information ac- 
quired by the terminal ability information acquiring sec- 
tion 9. 

[0088] By way of example, let us assume that the vid- 
eo content registered in the database B have image data 
in MPEG-2 coding format in 720 x 480 pixels resolution 
and sound data in MPEG-1 Audio Layer 2 coding format. 
At this time, if the terminal D is a cellular phone that can 
process image data in MPEG-4 coding format in size of 
176 x 144 pixels as well as sound data in GSM- AMR 
coding format, the video content should be output in the 
data format that can be processed by the terminal D by 
transforming the MPEG-2 coded image data in 720 x 
480 pixels resolution into the MPEG-4 coded image data 
in 176 x 144 pixels resolution and the MPEG-1 Audio 
Layer 2 coded sound data into the GSM- AMR coded 
sound data. Here, though an example in that the coding 
method and the resolution should be transformed is de- 
scribed, it is to be noted that the output content editing 
section 13 may transform a bit rate, a frame rate or other 
properties of the content. 

[0089] Further, if a file size of the read content is larger 
than, for example, an upper limit of the value that is as- 
sumed for the terminal D, the output content editing sec- 
tion 1 3 may send a part of the entire content, for exam- 
ple, by sending only image data in the content com- 
prised of the image data and sound data, cutting out a 
portion of the image to send, or, if the image data is lay- 
ered data and comprised of a base layer and an en- 
hancement layer, sending only the data in the base lay- 
er, and so on. 

[0090] Still further, if the user specifies any conditions 
such as, for example, that "a content to be retrieved 
must be free of charge and without restriction by copy- 
righr, charged content may not be delivered entirely in 
itself, but only a part of the content that can be delivered 
at no charge may be extracted. For example, if the con- 
tent is "movies", a series of typical scenes picked up 
from the entire movies like "a trailer film" may be a part 
of the content that can be delivered at no charge. 
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[0091] As described above, the output content editing 
section 13, based upon the terminal ability information 
from the terminal ability acquiring section 9, transforms 
the content read from the database B into any format 

5 suitable for the ability of the terminal D by transforming 
the format of the content or otherwise processing the 
content, and then the content delivering section 14 de- 
livers the edited or otherwise processed content to the 
terminal D via the network C. 

10 [0092] In the terminal D, when the content receiving 
section 32 receives the content from the apparatus A for 
retrieving and delivering the content acting as a server, 
the received content is output in any outputting format 
depending upon each media of the content, that is, it 

15 may be displayed to the user via the content outputting 
section 33, or may be output in the form of sounds, and 
so on. 

[0093] As described above, according to the first em- 
bodiment, the apparatus A for retrieving and delivering 

20 the content edits the retrieval result list acquired as a 
result of the retrieval and the content specified by the 
user based upon the processing ability of the terminal 
D so that the retrieval result list and the content can be 
received, displayed and output by the terminal D of the 

25 pertinent user, and therefore, the retrieval result list and 
the content that the user demands to be delivered may 
be readily displayed or output by various terminals each 
of which has different processing ability. 
[0094] In the first embodiment, though there is de- 

30 scribed an example wherein a content including-images 
and sounds are retrieved and delivered to the user as a 
result of retrieval with reference to sample pictures or 
images that the user shot for the retrieval, the present 
invention should not be limited to such case, a content 

35 comprised of images only may be retrieved and deliv- 
ered by using sample sounds, or, of course, a content 
comprised of imaged and sounds may be retrieved and 
delivered by using sample sounds. 
[0095] Further, in the first embodiment, though the in- 

40 put data registering section 1, the database B, and the 
retrieving and delivering service section 5 of the appa- 
ratus A for retrieving and delivering the content are de- 
scribed as being disposed in the same apparatus A, the 
present invention should not be limited to such configu- 

45 ration, that is, each of them may be disposed in different 
apparatuses A for retrieving and delivering the content. 
[0096] Still further, instead of generating the register- 
ing metadata in the input data registering section 1 as 
described above, the registering metadata may be gen- 

50 erated individually by authors of each content and reg- 
istered in the database B along with the corresponding 
content, or, alternatively, on the one hand, registering 
metadata specifying distributing conditions or other con- 
ditions may be generated by the authors of the content, 

55 and on the other hand, the other registering metadata 
describing the features of the content may be generated 
in the apparatus A for retrieving and delivering the con- 
tent, and then both may be registered in the database 
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B individually. 

[0097] Still further, the retrieval demanding section 21 
and the retrieval results processing section 29 de- 
scribed in the first embodiment may be disposed in dif- 
ferent terminals D respectively. 

(Second Embodiment) 

[0098] Though the apparatus A for retrieving and de- 
livering the content according to the first embodiment 
that retrieves the content by using the registering meta- 
data generated in the retrieving metadata generating 
section 26 of the terminal D is described, an apparatus 
A for retrieving and delivering content according to a 
second embodiment is configured to comprise a similar 
retrieving metadata generating section in the apparatus 
A for retrieving and delivering the content so that it gen- 
erates the registering metadata in the apparatus A for 
retrieving and delivering the content and retrieves the 
content by using the generated registering metadata. 
[0099] Fig. 8 is a diagram showing the configuration 
of a terminal D that corresponds to the apparatus A for 
retrieving and delivering the content of the second em- 
bodiment. In contrast to the terminal D of the first em- 
bodiment shown in Fig. 5, the terminal D that corre- 
sponds to the apparatus A for retrieving and delivering 
the content of the second embodiment is configured 
such that it does not comprise the retrieving metadata 
generating section 26 and therefore the content to be 
retrieved that are input through the content inputting 
section 24 are sent to the apparatus A for retrieving and 
delivering the content via the retrieval key outputting 
section 27 along with the user retrieval keys. 
[0100] Fig. 9 is a diagram showing the configuration 
of the apparatus A for retrieving and delivering the con- 
tent in the second embodiment. A retrieving metadata 
generating section 41 extracts features and additional 
information of the to be retrieved from the retrieval keys 
input through the retrieval key inputting section 5 and 
outputs the extracted information as the registering 
metadata for retrieval. Since other elements are similar 
to the ones in the apparatus A for retrieving and deliv- 
ering the content of the first embodiment shown in Fig. 
2, like elements are given like reference numerals and 
description of these elements is omitted. 
[0101] Next, an operation of the apparatus A will be 
described. 

[01 02] In the apparatus A for retrieving and delivering 
the content in the second embodiment, the retrieval key 
inputting section 7 of the retrieving and delivering serv- 
ice section 5 receives the retrieval keys from the termi- 
nal D via the network C and outputs the retrieval keys 
to the retrieving metadata generating section 41. Here, 
the retrieval keys received by the retrieving key inputting 
section 5 from the terminal D may include the user re- 
trieval keys and the content to be retrieved. 
[01 03] The retrieving metadata generating section 41 
extracts the features and the additional information of 



the content to be retrieved from the retrieval keys input 
through the retrieval key inputting section 5 and outputs 
the extracted information to the content retrieving sec- 
tion 10 along with the user retrieval keys as the regis- 

5 tering metadata for retrieval. 

[0104] The content retrieving section 10 inputs the 
registering metadata and the user retrieval keys from 
the registering metadata generating section 41, and 
then, as in the case of the first embodiment described 

10 above, based upon the registering metadata and the us- 
er retrieval keys, searches the database B to extract in- 
formation about the pertinent video content, and outputs 
the extracted information to the retrieval result list edit- 
ing section 11 as the retrieval result list. Since further 

75 operation is similar to the one of the first embodiment 
described above, its description is omitted. 
[0105] As described above, according to the second 
embodiment, the apparatus A for retrieving and deliver- 
ing the content is configured such that, as in the case of 

20 the first embodiment described above, the retrieval re- 
sult list resulting from retrieval and the content specified 
by the user can be readily displayed or output by the 
various terminals each of which has different processing 
ability, based upon the processing ability of the terminal 

25 D, and at the same time, the apparatus A for retrieving 
and delivering the content according to the second em- 
bodiment further comprises the retrieving metadata 
generating section 41 so that the terminal D does not 
need to have the retrieving metadata generating section 

30 26, and therefore the terminal D may have smaller circuit 
configuration. 

(Third Embodiment) 

35 [0106] Though, in the description of the apparatus A 
for retrieving and delivering the content according to the 
first and second embodiments, the contents and the reg- 
istering metadata are stored in the database B, an ap- 
paratus A for retrieving and delivering contents accord- 

40 ing a third embodiment is configured such that link in- 
formation to the contents is stored in the database B on 
behalf of the contents themselves, when the contents 
reside on the network C, that is, for example, the con- 
tents are stored in other databases, servers and so on 

45 that can be accessed via the network C. 

[01 07] Fig. 1 0 is a diagram showing the configuration 
of the apparatus A for retrieving and delivering the con- 
tent according to the third embodiment. In Fig. 10, an 
input controlling section 51 inputs the content from the 

50 network C and outputs the content to the output content 
editing section 13 when the link information to the con- 
tent is input to the output content editing section 1 3 from 
the database B. Since other elements are similar to the 
ones in the apparatus A for retrieving and delivering the 

55 content of the first embodiment shown in Fig. 2, like el- 
ements are given like reference numerals and descrip- 
tion of these elements is omitted. 
[0108] Next, an operation of the apparatus A will be 
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described. 

[01 09] To begin with, the process of the input data reg- 
istering section 1 according to the third embodiment will 
be described in detail. 

[0110] Fig. 11 is a flowchart showing the process of 5 
the input data registering section 1 when a new content 
is registered in the database B by the apparatus A for 
retrieving and delivering the content according to the 
third embodiment. 

[0111] First, the data inputting section 2, that compris- 10 
es either one or both of an interface for downloading and 
inputting the content via the network C and the other 
interface for inputting the content directly using any tool 
(not shown) and the like connected to the apparatus 
without the network C, inputs the content either from the ts 
network C, or from outside without the network C and 
outputs the content to the registering metadata gener- 
ating section 3 (Step ST51). 

[0112] The registering metadata generating section 3 
extracts information such as features, additional infor- 20 
mation and the like from the input content (Step ST52) 
and generates registering metadata (a feature descrip- 
tor) that describes the information such as the extracted 
features, the additional information and the like in a pre- 
defined format (Step ST53). It is to be noted that the 25 
process up to this step is similar to the one in the first 
and second embodiments. 

[0113] Next, in the third embodiment, it is determined 
whether the content input through the data inputting sec- 
tion 2 to be registered in the database B has resided on 30 
the network C and have been input from the network C, 
or the content has not been on the network C but input 
directly (Step ST54). 

[0114] Here, if it is determined that the registered con- 
tent has been input from the network C (Step ST54 35 
"Yes"), the registering metadata generating section 3 
stores the link information to download or otherwise ac- 
quire the pertinent content residing on the network C 
and the registering metadata for the content in the da- 
tabase B (Step ST55), on the other hand, if it is deter- *o 
mined that the registered content has not resided on the 
network C but has been input directly (Step ST54 "No"), 
the registering metadata generating section 3 stores the 
pertinent content themselves and the registering meta- 
data for the content in the database B (Step ST56). 45 
[0115] Next, the process of the retrieving and deliver- 
ing service section 5 of the apparatus A for retrieving 
and delivering the content according to the third embod- 
iment will be described in detail. 

[0116] Fig. 12 is a flowchart showing the process of 50 
the retrieving and delivering service section 5 of the ap- 
paratus A for retrieving and delivering the content ac- 
cording to the third embodiment. 
[0117] First, user information about the user is input 
from the terminal D to the user information inputting sec- 55 
tion 8 of the apparatus A for retrieving and delivering the 
content (Step ST61), and then retrieval keys including 
content retrieving metadata, user retrieval keys and the. 
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like are input from the terminal D to the retrieval key in- 
putting section 7 of the apparatus A for retrieving and 
delivering the content (Step ST62), and then a retrieval 
demanding signal that demands retrieval is further input 
from the terminal D to the user demand inputting section 
6 of the apparatus A for retrieving and delivering the con- 
tent (Step ST63). 

[01 1 8] When the retrieval demanding signal and the 
retrieval keys are input, the content retrieving section 10 
matches the input retrieval keys with the keyword and 
the features described in the registering metadata in- 
cluded in the database B (Step ST64), extracts the ad- 
ditional information stored along with each of one or 
more contents that consistent with or similar to the input 
retrieval keys and outputs a list of the additional infor- 
mation as the retrieval result list to the retrieval result 
list editing section 11 (Step ST65). 
[01 1 9] On the other hand, the user information input 
to the user information inputting section 8 is sent to the 
terminal ability information acquiring section 9 and the 
information about the processing ability of the terminal 
D that is included in the user information is acquired by 
the terminal ability information acquiring section 9 (Step 
ST66). Here, it is to be noted that, when the apparatus 
A for retrieving and delivering the content has user reg- 
istration function, it may be configured so that the user 
information is not sent from the terminal D to the appa- 
ratus A for retrieving and delivering the content, and at 
this time, information about the receiving terminal of the 
user may be registered in the apparatus A upon user 
registration in advance, the terminal ability information 
registered in the apparatus A for retrieving and deliver- 
ing the content may be acquired by referring to the user 
identification or other information. 
[0120] Then, the retrieval result list extracted from the 
database B and output by the content retrieval section 
10 is output to the retrieval result list editing section 11. 
[0121] The retrieval result list editing section 11, 
based upon the terminal ability information from the ter- 
minal ability acquiring section 9, edits the retrieval result 
list, that is, extracts only the information that can be re- 
ceived and displayed or otherwise output on the terminal 
p from the information included in the retrieval result list 
and so on (Step ST67), and delivers the edited retrieval 
result list from the retrieval result list outputting section 
12 to the terminal D via the network C (Step ST68). 
[0122] In the terminal D, the retrieval result list from 
the apparatus A for retrieving and delivering the content 
is input through the retrieval result list inputting section 
30 and displayed on the retrieval result list displaying 
section 31. 

[0123] Then, the user specifies a particular content 
from the contents listed in the retrieval result list dis- 
played on the retrieval result displaying section 31 
through the user command inputting section 22 and 
send the identification information as a user demand 
from the user demand outputting section 28 to the ap- 
paratus A for retrieving and delivering the content via 
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the network C. 
[01 24] In the apparatus A for retrieving and delivering 
the content, the user demand from the terminal D is input 
to the retrieving and delivering service section 5 through 
the user demand inputting section 6 and output to the 5 
output content editing section 1 3 (Step ST69). The proc- 
ess up to this step is similar to the one in the retrieving 
and delivering service section 5 of the apparatus A for 
retrieving and delivering the content according to the 
first embodiment shown in Fig. 4. to 
[0125] Next, the output content editing section 13 of 
the third embodiment reads only the registering meta- 
data specified by the content identification information 
input to the user demand inputting section 6 (Step 
ST70). It is because of the fact that, in the third embod- ts 
iment, the content specified by the content identification 
information either may be stored in the database B, or 
may reside on the network C, that is, for example, the 
content themselves may be stored in other databases, 
servers and the like that are accessible via the network 20 
C and, on the other hand, the link information to the con- 
tent residing on the network C may be stored in the da- 
tabase B. 

[0126] For this reason, in the apparatus A for retriev- 
ing and delivering the content of the third embodiment, 25 
the output content editing section 1 3 determines wheth- 
er or not the content that has been specified by the con- 
tent identification information and are to be retrieved are 
stored in the database B (Step ST71). 
[0127] Then, if the content to be retrieved are not 30 
stored in the database B (Step ST71 "No"), the content 
to be retrieved should reside on the network C, and 
therefore the output content editing section 1 3 inputs the 
content specified by the user by downloading or other- 
wise acquiring the content from the network C through 35 
the input controlling section 51 (Step ST72). On the oth- 
er hand, if the content to be retrieved are stored in the 
database B (Step ST71 "Yes"), the output content edit- 
ing section 1 3 reads and inputs the content specified by 
the user from the database B (Step ST73). *o 
[01 28] Then, in both cases, the output content editing 
section 13 determines whether or not the content that 
has been specified by the user and read from either the 
database B or the network C can be received and dis- 
played or otherwise output by the terminal D, based up- « 
on the terminal ability information acquired by the termi- 
nal ability information acquiring section 9 (Step ST74). 
[0129] Then, if it is determined that the input content 
can be received and displayed or otherwise output by 
the terminal D (Step ST74 "Yes"), the output content ed- so 
iting section 13 outputs the input content to the content 
delivering section 14 and the content delivering section 
14 delivers the content received from the output content 
editing section 13 to the terminal D (Step ST76). 
[0130] In contrast, if it is determined that the input con- 55 
tent cannot be received and output by the terminal D 
(Step ST74 "No"), the output content editing section 13 
edits the input content by transforming or otherwise 



processing the content into a form that can be received 
and output by the corresponding terminal D (Step 
ST75), and outputs the edited content to the content de- 
livering section 14. The content delivering section 14 de- 
livers the content that the content editing section 13 
have transformed or otherwise edited into the form that 
can be received and output by the terminal D to the cor- 
responding terminal D (Step ST76). 
[01 31] As described above, according to the third em- 
bodiment, as in the case of the first and second embod- 
iments also described above, the apparatus A for re- 
trieving and delivering the content edits the content 
specified by the user into the form that can be received 
and output by the terminal D based upon the processing 
ability of the terminal D, and therefore the content spec- 
ified to deliver as a result of retrieval can be readily out- 
put by various terminals each of which has different 
processing ability. 

[01 32] In Particular, in the third embodiment, since the 
contents that reside on the network C are not stored in 
the database B, and, on behalf of the contents them- 
selves, the link information to the content is stored in the 
database B, more contents can be registered in the da- 
tabase B of the apparatus A for retrieving and delivering 
the content. 

(Fourth Embodiment) 

[0133] Though in the above description of the first, 
second and third embodiments, matching to a retrieve 
content is performed without assigning weights to fea- 
tures described in metadata, an apparatus for retrieving 
and delivering contents according to a fourth embodi- 
ment is configured such that a content is retrieved by 
extracting features of different types described in the 
metadata, calculating a feature coefficient by summing 
each of the features with weighting, and then matching 
the content with the feature coefficient acquired by the 
above summing. 

[01 34] Though it is to be noted that the fourth embod- 
iment may be applied to any of the first, second and third 
embodiments described above, here only distinctive op- 
eration of the fourth embodiment will be described tak- 
ing the apparatus A for retrieving and delivering the con- 
tent of the first embodiment shown in Fig. 2 as an ex- 
ample. 

[0135] To begin with, an operation of the input data 
registering section 1 to register content will be de- 
scribed. 

[0136] When the content is registered in the database 
B, the registering metadata generating section 3 of the 
apparatus A for retrieving and delivering the content ac- 
cording to the fourth embodiment extracts features of 
different types from the content, acquires a weight co- 
efficient corresponding to each of the extracted features 
by means of a weight coefficient table prepared in ad- 
vance and the like, calculates weighted features by mul- 
tiplying the acquired features by the weight coefficient, 
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and finally calculates a feature coefficient by summing 
the weighted features. 

[0137J Fig. 13 shows an example of a weight coeffi- 
cient table of the fourth embodiment. In the fourth em- 
bodiment, since a list of weight coefficients that corre- 
spond to each type of features such as "an averaged 
value of hue components of images", "horizontal com- 
ponents of averaged motion vectors of objects included 
in images" and the like as shown in Fig. 13 is prepared, 
the weighted features are acquired by multiplying the 
features extracted when the contents are input by the 
weight coefficient that is in the list of Fig. 13 and corre- 
sponds to each of the features, and then the feature co- 
efficient is calculated by summing the calculated weight- 
ed features. The feature coefficient may be stored, for 
example, in the database B along with the contents or 
the link information to the contents. 
[0138] Next, an operation of the retrieving and deliv- 
ering service section 5 to retrieve the content will be de- 
scribed. 

[0139] When the content retrieving section 10 re- 
trieves the content in the database B, the feature coef- 
ficient is acquired in a manner similar to the one de- 
scribed above, that is, by summing features of different 
types included in the retrieval keys input to the content 
retrieving section 10 with weighting, using the same 
weight coefficient table as the one that is used to register 
the content. Then the content retrieving section 10 re- 
trieves the content by matching the feature coefficient 
acquired above with the feature coefficient registered in 
the database B. The subsequent operation after that is 
similar to the one in the first embodiment. 
[0140] As described above, the apparatus A for re- 
trieving and delivering the content in accordance with 
the fourth embodiment can readily display or output the 
retrieval result list acquired as a result of retrieval in the 
database B and the content read from the database B 
on the various terminals D each of which has different 
processing ability as in the case of the first or other em- 
bodiments described above, and at the same time, it can 
retrieve the content quickly since it registers the feature 
coefficient or feature vector that has been acquired by 
summing the features of the content with weighting in 
the database B, and it retrieves the content using the 
feature coefficient or feature vector. 
[0141] Though the apparatus A for retrieving and de- 
livering the content of the fourth embodiment is de- 
scribed as being applied to the first embodiment, it is to 
be noted that the apparatus can be also applied, of 
course, to the second and third embodiments. 
[0142] Further, in the description of the apparatus A 
for retrieving and delivering the content of the fourth em- 
bodiment, though a sum of weighted features acquired 
by multiplying a weight coefficient is used to retrieve the 
content as a feature coefficient, the present invention 
should not be limited to such configuration, that is, for 
example, a plurality of feature coefficients may be ac- 
quired by summing a plurality of weighted features one 
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by one or some by some, and the content may be re- 
trieved by using a feature vector that uses the plurality 
of weighted features as its coefficient. 
[01 43] Still further, in the description of the apparatus 

5 A for retrieving and delivering the content of the fourth 
embodiment, though the feature coefficient or feature 
vector is registered upon registration of data, the 
present invention should not be limited to such configu- 
ration, that is, for example, it may be configured, of 

10 course, so as to acquire a quantized coefficient or a 
quantized vector by quantizing the feature coefficient or 
feature vector and then register an index corresponding 
to the quantized coefficient or the quantized vector. 

15 Industrial Applicability 

[0144] As described above, the apparatus and the 
method for retrieving and delivering the content accord- 
ing to the present invention are suitable for delivering 
20 the content and the retrieval result list acquired as a re- 
sult of retrieval in various types of formats correspond- 
ing to various terminals each of which has different 
processing ability via various networks such as a tele- 
phone line, a wireless network and so on. 

25 

Claims 

1 . An apparatus for retrieving and delivering a content 
30 that searches a database where contents and their 

additional information are stored based upon infor- 
mation from a terminal and delivers data extracted 
as a result of the search to said terminal, wherein: 

35 the data extracted as a result of said search is 

edited depending upon processing ability of 
said terminal and delivered to said terminal. 

2. The apparatus for retrieving and delivering a con- 
40 tent according to claim 1 , comprising: 

a content retrieving section that searches said 
database based upon the information from said 
terminal, extracts the additional information of 

45 the content acquired as a result of the search 

and outputs a retrieval result list in which the 
additional information is published; 
a retrieval result list editing section that, based 
upon the information from said terminal, edits 

so the retrieval result list obtained from said con- 

tent retrieving section into any format that can 
be displayed on a particular terminal depending 
upon the processing ability of said terminal; and 
a retrieval result list delivering section that de- 

55 livers the retrieval result list edited by said re- 

trieval result list editing section to said terminal. 

3. The apparatus for retrieving and delivering a con- 
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7. 



tent according to claim 2, wherein: 

said database stores weighted registering 
metadata as said additional information; and 
said content retrieving section searches said 
database with reference to said registering 
metadata based upon the information obtained 
from said terminal and extracts the additional 
information of the content acquired as a result 
of said search. 

The apparatus for retrieving and delivering a con- 
tent according to claim 2, further comprising a re- 
trieving metadata generating section that generates 
metadata for retrieving the content based upon the 
information from said terminal and outputs it to said 
content retrieving section, wherein: 

said content retrieving section searches said 
database based upon the information from said 
terminal and the metadata from said retrieving 
metadata generating section, extracts the ad- 
ditional information of the content acquired as 
a result of the search, and outputs the retrieval 
result list in which the additional information is 
published. 

The apparatus for retrieving and delivering a con- 
tent according to claim 3, further comprising a re- 
trieving metadata generating section that generates 
metadata for retrieving the content based upon the 
information from said terminal and outputs it to said 
content retrieving section, wherein: 

said content retrieving section searches said 
database based upon the information from said 
terminal and the metadata from said retrieving 
metadata generating section, extracts the ad- 
ditional information of the content acquired as 
a result of the search, and outputs the retrieval 
result list in which the additional information is 
published. 

The apparatus for retrieving and delivering a con- 
tent according to claim 1 , comprising: 

an output content editing section that reads the 
content from said database based upon the in- 
formation obtained from said terminal and edits 
the read content into any format that can be 
processed on the particular terminal depending 
upon the processing ability of said terminal; and 
a content delivering section that delivers the 
content edited by said output content editing 
section to said terminal. 

The apparatus for retrieving and delivering a con- 
tent according to claim 2, comprising: 



an output content editing section that reads the 
content from said database based upon the in- 
formation from said terminal and edits the read 
content into any format that can be processed 
5 on the particular terminal depending upon the 

processing ability of said terminal; and 
a content delivering section that delivers the 
content edited by said output content editing 
section to said terminal. 

10 

8. The apparatus for retrieving and delivering a con- 
tent according to claim 3, comprising: 

an output content editing section that reads the 
15 content from said database based upon the in- 

formation from said terminal and edits the read 
content into any format that can be processed 
on the particular terminal depending upon the 
processing ability of said terminal; and 
20 a content delivering section that delivers the 

content edited by said output content editing 
section to said terminal. 

9. The apparatus for retrieving and delivering a con- 
25 tent according to claim 4, comprising: 

an output content editing section that reads the 
content from said database based upon the in- 
formation from said terminal and edits the read 

30 content into any format that can be processed 

on the particular terminal depending upon the 
processing ability of said terminal; and 
a content delivering section that delivers the 
content edited by said output content editing 

35 section to said terminal. 

1 0. The apparatus for retrieving and delivering a con- 
tent according to claim 5, comprising: 

40 an output content editing section that reads the 

content from said database based upon the in- 
formation from said terminal and edits the read 
content into any format that can be processed 
on the particular terminal depending upon the 

45 processing ability of said terminal; and 

a content delivering section that delivers the 
content edited by said output content editing 
section to said terminal. 

so 11. The apparatus for retrieving and delivering a con- 
tent according to claim 6, wherein: 

said database either stores the contents and 
registering metadata for the particular con- 
55 tents, or stores link information to contents and 

registering metadata for the particular con- 
tents, and 

said output content editing section further 
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reads said link information from said database 
based upon the information from said terminal 
and then reads the content based upon said link 
information. 



searches a database where contents and their ad- 
ditional information are stored based upon informa- 
tion from a terminal and delivers data extracted as 
a result of the search to said terminal, wherein: 



5 



12. The apparatus for retrieving and delivering a con- 
tent according to claim 7, wherein: 



the data extracted as a result of said search is 
edited depending upon processing ability of 
said terminal and delivered to said terminal. 



said database either stores contents and reg- 
istering metadata for the particular contents, or to 
stores link information to contents and register- 
ing metadata for the particular contents, and 
said output content editing section further 
reads said link information from said database 
based upon the information from said terminal 15 
and then reads a contents based upon said link 
information. 

13. The apparatus for retrieving and delivering a con- 
tent according to claim 8, wherein: 20 

said database either stores contents and reg- 
istering metadata for the particular contents, or 
stores link information to contents and register- 
ing metadata for the particular contents, and 25 
said output content editing section further 
reads said link information from said database 
based upon the information from said terminal 
and then reads a content based upon said link 
information. 30 

14. The apparatus for retrieving and delivering a con- 
tent according to claim 9, wherein: 

said database either stores contents and reg- 35 
istering metadata for the particular contents, or 
stores link information to contents and register- 
ing metadata for the particular contents, and 
said output content editing section further 
reads said link information from said database *o 
based upon the information from said terminal 
and then reads a contents based upon said link 
information. 

15. The apparatus for retrieving and delivering contents 45 
according to claim 10, wherein: 

said database either stores contents and reg- 
istering metadata for the particular contents, or 
stores link information to contents and register- so 
ing metadata for the particular contents, and 
said output content editing section further 
reads said link information from said database 
based upon the information from said terminal 
and then reads a content based upon said link 55 
information. 

1 6. A method for retrieving and delivering a content that 
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